Web Survey Bibliography
Background: Increasingly, Web-based health applications are developed for the prevention and management of chronic diseases. However, their reach and utilization is often disappointing. Qualitative evaluations post-implementation can be used to inform the optimization process and ultimately enhance their adoption. In current practice, such evaluations are mainly performed with end-user surveys. However, a review approach by experts in a focus group may be easier to administer and might provide similar results.
Objective: The aim of this study was to assess whether industrial design engineers in a focus group would address the same issues as end users in a Web-based survey when evaluating a commercial Web-based health risk assessment (HRA) with tailored feedback.
Methods: Seven Dutch companies used the HRA as part of their corporate health management strategy. Employees using the HRA (N = 2289) and 10 independent industrial designers were invited to participate in the study. The HRA consisted of four components: (1) an electronic health questionnaire, (2) biometric measurements, (3) laboratory evaluation, and (4) individually tailored feedback generated by decision support software. After participating in the HRA as end users, both end users and designers evaluated the program. End users completed an evaluation questionnaire that included a free-text field. Designers participated in a focus group discussion. Constructs from user satisfaction and technology acceptance theories were used to categorize and compare the remarks from both evaluations.
Results: We assessed and qualitatively analyzed 294 remarks of 189 end users and 337 remarks of 6 industrial designers, pertaining to 295 issues in total. Of those, 137 issues were addressed in the end-user survey and 148 issues in the designer focus group. Only 7.3% (10/137) of the issues addressed in the survey were also addressed in the focus group. End users made more remarks about the usefulness of the HRA and prior expectations that were not met. Designers made more remarks about how the information was presented to end users, quality of the feedback provided by the HRA, recommendations on the marketing and on how to create more unity in the design of the HRA, and on how to improve the HRA based on these issues.
Conclusions: End-user surveys should not be substituted for expert focus groups. Issues identified by end users in the survey and designers in the focus group differed considerably, and the focus group produced a lot of new issues. The issues addressed in the focus group often focused on different aspects of user satisfaction and technology acceptance than those addressed by the survey participants; when they did focus on the same aspects, then the nature of issues differed considerably in content.
Homepage (Abstract)
Web survey bibliography (4086)
- Online Polls and Registration-Based Sampling: A New Method for Pre-Election Polling; 2014; Barber, M. J., Mann, C. B., Monson, J. Q., Patterson, K. D.
- Keeping Surveys Valid, Reliable, and Useful: A Tutorial; 2014; Greenberg, M. R., Weiner, M. D.
- Improving Response Rates and Questionnaire Design for Mobile Web Surveys; 2014; de Bruijne, M., Wijnant, A.
- Surveying Louisiana waterfowl hunters: Open web and random mail surveys produce similar responses to...; 2014; Laborde, L. P., Rohwer, F. C., Kaller, M. D., Reynolds, L. A.
- Strategies to address participant misrepresentation for eligibility in Web-based research; 2014; Rubin, A., Coster, W., Helmuth, E., Hermos, J., Kramer, J., Rosenbloom, D.
- Accessing sexual health information online: use, motivations and consequences for youth with different...; 2014; Mitchell, K. J., Ybarra, M. L., Korchmaros, J. D., Kosciw, J. G.
- Efficiencies of Internet-Based Digital and Paper-Based Scientific Surveys and the Estimated Costs and...; 2014; Uhlig, C. E., Seitz, B., Promesberger, J., Eter, N., Busse, H.
- Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison; 2014; Ansolabehere, S., Schaffner, B. F.
- Nonresponse and Mode Effects in Self- and Interviewer-Administered Surveys; 2014; Atkeson, L. R.; Adams, A. N.; Alvarez, M. R.
- Internet-Based Surveys: Methodological Issues; 2014; Albaum, G., Brockett, P., Golden, L., Han, V., Roster, C. A., Smith, S. M., Wiley, J. B.
- Mixed-mode surveys of the general population - Results from the European Social Survey mixed-mode experiment...; 2014; Park, A., Humphrey, A.
- Assessing Within-Household Selection Methods in Household Mail Surveys; 2014; Olson, K., Stange, M., Smyth, J. D.
- Invitation Design Elements in Web Surveys - Can One Ignore Interactions?; 2014; Mavletova, A. M., Deviatko, I., Maloshonok, N.
- Do Web surveys facilitate reporting less favourable opinions about law enforcement?; 2014; Boivin, R., Cordeau, G.
- Web Surveys in Official Statistics; 2014; Bethlehem, J.
- Why Do Respondents Break Off Web Surveys and Does It Matter? Results From Four Follow-up Surveys; 2014; Rossmann, J., Blumenstiel, J. E., Steinbrecher, M.
- The Effectiveness of Mailed Invitations for Web Surveys and the Representativeness of Mixed-Mode versus...; 2014; Bandilla, W., Couper, M. P., Kaczmirek, L.
- Smoking status, service use and associated factors among Japanese cancer survivors - a web-based survey...; 2014; Basaki-Tange, A., Fujimori, M., Fujisawa, D., Umezawa, S., Miyashita, M.
- Gender Differences in Internet Addiction Associated with Psychological Health Indicators Among Adolescents...; 2014; Ha, Y.-M., Hwang, W. J.
- Post-endodontic treatment of incisors and premolars among dental practitioners in Saarland: an interactive...; 2014; Mitov, G., Doerr, M., Nothdurft, F. P., Draenert, F., Pospiech, P. R.
- Mixed-Mode Designs bei Erhebungen mit sensitiven Fragen: Einfluss auf das Teilnahme- und Antwortverhalten...; 2014; Krug, G., Kriwy, P., Carstensen, J.
- Meta-analysis of randomized controlled trials supports the use of incentives for inducing response to...; 2014; David, M. C., Ware, R. S.
- Quality of physical therapy from a patient's perspective; factor analysis on web-based survey data...; 2014; Scholte, M., Calsbeek, H., Nijhuis-van der Sanden, M. W. G., Braspenning, J.
- Evaluating a Web-based health risk assessment with tailored feedback: What does an expert focus group...; 2014; Vosbergen, S., Mahieu, G. R. Laan, E. K., Kraaijenhagen, R. A., Jaspers, M. W. M., Peek, N.
- Drivers' road accident risk perception. A comparison between face-to-face interview and web-based...; 2014; Cardamone, A. S., Eboli, L., Mazzulla, G.
- Measuring Political Participation—Testing Social Desirability Bias in a Web-Survey Experiment; 2014; Persson, M., Solevid, M.
- Prioritisation of alternatives with analytical hierarchy process plus response latency and web survey...; 2014; Barone, S. Errore, A., Lombardo, A.
- Accuracy of Within-household Selection in Web and Mail Surveys of the General Population.; 2014; Olson, K., Smyth, J. D.
- Discriminating the Effects of Cannabis sativa and Cannabis indica: A Web Survey of Medical Cannabis...; 2014; Pearce, D. D., Mitsouras, K., Irizarry, K. J.
- Measurement effects between CAPI and Web questionnaires in the UK Household Longitudinal Study; 2014; Lynn, P., Vannieuwenhuyze, J. T. A.
- Role of mode in respondents’ decisions to participate in IP5: findings from a qualitative follow...; 2014; Collins, D., Mitchell, Ma.
- Understanding Society Innovation Panel Wave 6: results from methodological experiments; 2014; Allum, N., Auspurg, K., Blake, M., Booker, C. L., Crossley, T. F., D'ardenne, J., Fairbrother, M., Iacovou...
- Considerations for Conducting Web-Based Survey Research With People Living With Human Immunodeficiency...; 2014; O'Brien, K. K., Solomon, P., Worthington, C., Ibánieez-Carrasco, F., Baxter, L., Nixon, S. A., Baltzer...
- Use of a Google Map Tool Embedded in an Internet Survey Instrument: Is it a Valid and Reliable Alternative...; 2014; Dasgupta, S., Vaughan, A. S., Kramer, M. R., Sanchez, T. H., Sullivan, P. S.
- WEBDATANET: Innovation and Quality in Web-Based Data Collection ; 2014; Steinmetz, S., Slavec, A., Tijdens, K. G., Reips, U.-D., de Pedraza, P., Popescu, A., Belchior, A., ...,...
- Mining “Big Data” using Big Data Services ; 2014; Reips, U.-D., Matzat, U.
- Instant Interactive Feedback in Grid Questions: Reminding Web Survey; 2014; Kunz, T., Fuchs, M.
- What Does the Satisfaction with Democracy Measure Mean to Respondents in Different Countries? How Cross...; 2014; Behr, D., Braun, M.
- WebSM Study: Overview of Features and Pricing of Software Packages in 2014; 2014; Vehovar, V., Cehovin, G.
- Using Eye Tracking to Evaluate Email Notifications of Surveys and Online Surveys Collecting Address...; 2014; Olmsted, E. L., Nichols, E. M.
- Respondent Processing of Multiple Images throughout a Web Survey; 2014; Charoenruk, N., Stange, M.
- Using Eye Tracking to Examine the Visual Design of Web Surveys; 2014; Zhou, Q., Ricci, K., Olson, K., Smyth, J. D.
- Achieving Balance: Understanding the Relationship between Complexity and Response Quality; 2014; Kirchner, A., Powell, R.
- Question Grouping and Matrices in Web Surveys: Using Response and Auxiliary Data to Examine Question...; 2014; Bilgen, I., Stern, M. J.
- The Grouping of Items in Mobile Web Surveys; 2014; Mavletova, A. M., Couper, M. P.
- Evaluating the Efficacy of Mixed-Mode Intercept Surveys for Complex Questionnaires; 2014; Puniello, O. T.
- Experiments with Email Formatting; 2014; Lawrence, S., Phillips, B. T.
- Sequential or Simultaneous Multi-Mode? Results from Two Large Surveys of Electric Utility Consumers; 2014; Jackson, C., Ledoux, C.
- Correlates of Attrition in the German Internet Panel: Drop-Outs and Sleepers; 2014; Blom, A. G., Beissel-Durrant, G.
- Survey Breakoff in Online Panels; 2014; McCutcheon, A. L.